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Abstract 

This paper considers non-cooperative and fully-distributed power-allocation for selfish transmitter- 
receiver pairs in shared unlicensed spectrum when normalized-interference to each receiver is uncertain. 
We model each uncertain parameter by the sum of its nominal (estimated) value and a bounded additive 
error in a convex set, and show that the allocated power always converges to its equilibrium, called robust 
Nash equilibrium (RNE). In the case of a bounded and symmetric uncertainty region, we show that the 
power allocation problem for each user is simplified, and can be solved in a distributed manner. We 
derive the conditions for RNE's uniqueness and for convergence of the distributed algorithm; and show 
that the total throughput (social utility) is less than that at NE when RNE is unique. We also show that for 
multiple RNEs, the social utility may be higher at a RNE as compared to that at the corresponding NE, 
and demonstrate that this is caused by users' orthogonal utilization of bandwidth at RNE. Simulations 
confirm our analysis. 

Index Terms 

Distributed power control, robust game theory, spectrum sharing, uncertainty region, worst-case 
optimization. 

I. Introduction 

Opportunistic spectrum sharing where multiple wireless transmitters and receivers share the same 
portion of bandwidth is a promising approach for improving spectrum efficiency in future wireless 
communication systems Q. In this setup, each user aims to maximize its utility subject to its power limit 
and other regulatory restrictions, such as spectrum mask and/or the maximum amount of interference |0. 
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Because of the inherently decentralized and competitive nature of allocating power to users, game 
theory Q is an appropriate tool for analyzing such systems IH-dl. In this context, the power allocation 
problem is formulated as a strategic non-cooperative game, where each user is considered as a rational 
player that competes with others by choosing a transmission strategy for maximizing its own utility, 
defined as its throughput. In a game, Nash equilibrium (NE) is a state, consisting of the strategy space 
and utility values, at which there is no incentive for any player to change its strategy, provided that 
other players' strategies are not changed. As such, one needs to derive the conditions for existence and 
uniqueness of NE, to develop a distributed algorithm for reaching NE, and to examine the convergence 
conditions for that algorithm. 

The well known iterative water-filling algorithm (IWFA) for reaching NE of a power allocation game, 
as well as the conditions for existence of NE and convergence conditions of IWFA are proposed in 
Besides, in (U, |4), |6j, lfT0l - lfT5l . other distributed water-filling based algorithms and conditions for their 
convergence are studied, and the sufficient conditions for existence and uniqueness of NE under different 
power constraints and system models are derived. In many of the existing power allocation schemes (e.g., 
in HH-HH), it is assumed that the channel state information, and interference from other users plus 
noise (IN) are available to each user. However, this assumption may not be valid in practice, due to the 
time-varying environment and inaccurate measurements, resulting in uncertainties in parameter values. 

Motivated by the aforementioned challenge, we wish to develop a robust game-theoretic approach 
for tackling such uncertainties in the power allocation problem. Generally, to model the uncertainty, 
each uncertain parameter is assumed to be the sum of its nominal (or estimated value) and an additive 
error [19]. Based on the available information on the additive error, a robust approach is considered. 
In the literature, there are two major approaches for introducing robustness |fT9l , GUI : The Bayesian 
approach where the statistics of errors are considered and the network's performance is probabilistically 
guaranteed; and the worst-case approach where a deterministic value bounded with a given probability 
in a closed region (called the uncertainty region), is considered for the additive error, and the network's 
performance is guaranteed for any realization of uncertainty within the uncertainty region. In this paper, 
for brevity, we use the term "bounded" instead of the term "bounded with a given probability". Both 
of the above mentioned approaches have been applied to the power allocation problem in spectrum 
sharing environments. The term "worst-case approach" is used in the literature to denote the fact that for 
any realization of uncertainty in the bounded region, including the bounds (i.e., the worst-case for the 
uncertainty), the network's performance is guaranteed by the proposed robust approach. 

In Q, a probabilistic robust IWFA is proposed, where IN levels are uncertain; and by assuming a 
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uniform probability density function (pdf) for uncertainty in IN levels, the power allocation problem is 
converted to the conventional IWFA, but the IN level is multiplied by a factor that corresponds to the 
stochastic nature of uncertainty. In (8], the worst-case robust optimization theory is used when uncertainty 
in the channel state information between users is bounded in an ellipsoid region to derive the conditions 
for NE's existence and uniqueness, and a distributed algorithm that needs additional message passing 
between users is proposed. Compared to pervious works, our main contributions in this paper are two 
folds. First, we propose a simple robust distributed power allocation scheme that does not need any 
additional message passing in the system; and second, we analyze and compare the equilibrium of the 
robust approach with that of the power allocation problem with no uncertainties. 

In doing so, we assume that the IN level for each user normalized by its direct channel gain is uncertain, 
and as in 151, ll8l, model each uncertain parameter by the sum of its nominal (estimated) value plus a 
bounded additive error, the collection of which for all instances of error form the uncertainty region. 
The corresponding game is based on the robust optimization theory ETTl . where each user obtains its 
transmit power level that maximizes its throughput in the worst-case instance in the uncertainty region 
EOl . and the equilibrium of such a game is called the robust Nash equilibrium (RNE). We will show that 
when the uncertainty region is a closed convex set, RNE always exists, but a closed form solution for 
RNE may not be obtainable for some forms of the uncertainty region. We focus on bounded symmetric 
uncertainties, and utilize the framework in lfl"3l . lTT4l to obtain the necessary conditions for uniqueness of 
RNE. Moreover, to reach RNE, we will apply the totally asynchronous and distributed power allocation 
algorithm introduced in E2l . and obtain the condition for its convergence. 

Another important subject in this paper is to obtain the difference between RNE of the robust game with 
uncertain parameter values and NE of the nominal game (the game with complete information). We show 
how uncertainty affects the total throughout, i.e., the social utility of users at RNE as compared to that of 
nominal game. We also show that when RNE is unique, the strategy of users as well as the social utility 
of the game are decreasing functions of the bound on the uncertainty region. Besides, we demonstrate that 
uncertainty reduces the total throughput of users when RNE is unique, but not necessarily for multiple 
RNEs. When multiuser interference is high, multiple RNEs may exist in IWFA-based algorithms for 
the robust game. In such cases, uncertainty may lead to a more orthogonal power allocation at one 
RNE, resulting in less interference between users and consequently, higher total throughput of users as 
compared to the total throughput of the nominal game. 

This paper is organized as follows. In Section II, we present the system model of a spectrum sharing 
environment, and formulate a robust game for the power allocation problem, when users' channel state 
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information and IN levels are uncertain. In Section III, we investigate the existence and uniqueness 
conditions of RNE in the proposed game, and study the effect of uncertainties on the total throughput 
at RNE as compared to the same at NE of the complete information game. Our distributed algorithm is 
proposed in Section IV, followed by simulation results in Section V, and conclusions in Section VI. 

II. System Model and Problem Statement 

We consider a set of A4 = {1, ••• , M} transmitter and receiver pairs sharing K, = {1, • • • , K} 
orthogonal narrow band sub-channels. The bandwidth of each sub-channel is much less than the coherence 
bandwidth of the wireless channel, meaning that the channel response of each sub-channel is flat. The 
transmit power vector of the i th user over all sub-channels is p 4 = \p\ , ■ ■ ■ , pf] , where p\ is the transmit 
power of the i th user in the k th sub-channel. The received signal power at the corresponding receiver in 
sub-channel k is 

M 

^ = 5>i^ + ^' Vj€A*, keJC, (1) 

where is the fading sub-channel gain from the j th transmitter to the i th receiver on the fc th sub-channel, 
and a\ is the noise power in the k th sub-channel of the i th user. At receiver i, signal-to-interference- 
plus-noise-ratio (SINR) in sub-channel k is 7^ = where = — 3 * % ^ k J1 — - denotes the induced 
interference plus noise to user i normalized by its direct channel gain. We assume that at the receiver 
of each user, the value of IN in each sub-channel and the corresponding direct channel gain are 
measured. The receiver calculates the value of which is the normalized interference caused due to 
the direct channel gain, and sends it to the corresponding transmitter via the feedback channel. Each 
transmitter uses the received value of to calculate the power level in each sub-channel. At the receiver, 
the value of SINR in each sub-channel can be calculated by and the achievable rate for the i th 
receiver is obtained by R L = Y^k=i^°&0- + li)- ^ ne transmit power of each user is subject to the 
following constraints: 

C\ : The total transmit power of the i th user over all sub-channels is limited by its maximum power 

budget, i.e., Ek=iPi <PT"- 
C2' The transmit power of each user on each sub-channel is limited, i.e., < < p mask , where 
p mask is the spectral mask on sub-channel k. 
We assume that users cannot perform interference cancelation |[T3l . 
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A. Game Formulation 

In noncooperative spectrum sharing in unlicensed bands, each user aims to maximize its own utility, 
defined as its throughput, subject to C± and Ci- In contrast to cognitive radio networks where primary 
(licensed) users have absolute priority over secondary (unlicensed) users in utilizing the frequency 
spectrum, in noncooperative spectrum sharing in unlicensed bands CQ, all users are treated the same, i.e., 
there is no priority among users. In such cases, noncooperative strategic game theory ||3] is an appropriate 
tool for analyzing such a greedy behavior by each users where all users act independently to achieve their 
objectives without any coordination. The strategic game consists of three elements: the set of players, 
the utility of each player, and the action set of players, where the action of each player is its strategy for 
optimizing its utility. 

For our power allocation problem, the set of players is the set of all transmitters and receivers in the 
wireless channel denoted by M., the action of each player is its transmit power over K sub-channels 
denoted by pi, and the utility of each user is its achieved throughput over all K sub-channels. This game 
is denoted by Q = (M, {V^ieM^ { u i}i£M)> where V{ is the action set of player i defined as 

K 

Pi = {p«iX>t <pT, o<pt<pi^ wet}, (2) 

k=l 

and Ui(p) is the utility of user i, and depends on the chosen strategy vector of all users, i.e., 

K k 

= J>g(l + ^), (3) 

k=l Si 

where p = [p s , p_ 4 ], and p t = [p 1} • • • , p, x , p i+1 , ■ ■ ■ , PjJ ] is a vector of the actions of all users except 
user i. 

In the noncooperative strategic game, each player maximizes its own utility based on actions of other 
players. Since the utility function of each user for the power allocation problem is achieved throughput 
i.e. ([3]), and its strategy space is defined by ©, optimization of the allocated power is stated by the 
following problem 

™ log(l + f|) (4) 



subject to < 



Ci:Ef =1 P?<Pr 
% C 2 :0<^<pLk 

The commonly used concept for analyzing the outcome of this type of game-theoretic schemes is the 
Nash equilibrium (NE). NE represents a strategy set of all players in the game where no player can 
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improve its utility by unilaterally changing its action J3]. In the power allocation problem, the strategy 
profile p* = {p*, • • • , p* M } is NE for the game Q if 

Ui(p*,p*J> Ui (p t ,p*J, Vp^Pi, Vie At (5) 

One approach for reaching NE is to use the best response dynamic algorithm 0, |[T3l . ll23l . For the 
power allocation problem, the best response of user i, given the transmit power levels of other users, 
is the optimal solution to (0]) |T3l . Since Q is a convex optimization problem with respect to pi, its 
solution can be obtained by the Lagrange dual function. The dual function of (O is 

K k K 

Hpu a,) = £ log(l + %) + \* x (J2 p* - pD, (6) 

k=l Si k=l 

where Aj > is the dual variable for user i that satisfies its C\, i.e., 

K 

AiX^-pD^, Vie At (7) 
k=l 

The allocated power to each user can be obtained by the first order optimality condition of the Lagrange 
dual function, i.e., via d-Mpi.AO = as 

rf = if (8) 

where [x\ b a for a < b denotes the Euclidean projection of x onto the interval [a, b], i.e., \xy a = a if x < a, 
[x\ b a = ax if a < x < b, and [x] b a = b if b < x. This best response solution to (H} for each player is 
called the water-filling solution |[T3l . ll24l . and the iterative algorithm utilized by each player to reach 
the equilibrium point is called the iterative water filling algorithm (IWFA) Q, |[T3l . |[T4l . 

To analyze the performance of the game, one needs to investigate the existence and uniqueness of 
NE, propose a distributed algorithm to reach NE, and obtain its convergence conditions. For the power 
allocation problem, since the utility function tt,(p) is concave on p., and the action set of each user 
is closed and convex, the game Q has a nonempty solution set for any set of channels, spectral mask 
constraints, and transmit power levels. Hence, a NE always exists O. However, uniqueness of NE for 
the power control game cannot be guaranteed in the general case. To analyze the uniqueness of NE in 
the power allocation problem, different conditions have been derived for the game Q in the literature, 
depending on the interference channel gains and noise levels in the system as in O, ifTTTl . lfT3l , |23l , 
||25l via best-response algorithms and principles of contraction mapping. Briefly, in all existing literature 
(e.g., in ]9), |[T3l . ifTTl ). it is shown that if multiuser interference is low, the game has a unique NE, 
and when multiuser interference is high, the game has multiple NEs. In this paper, to analyze our robust 
game, we utilize the framework introduced in ||T3l to derive the condition for uniqueness of RNE. 
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B. Robust Counterpart Game Formulation 

In the above formulation for game Q, it is assumed that the exact value of s 1 - for each sub-channel 
is available to the respective receiver with no error. This value is sent to the corresponding user via the 
feedback channel. However, due to the dynamic nature of spectrum sharing environments manifested 
in channel variations, users' movements, entering new users in the system, as well as the delay in the 
feedback channel, errors are introduced in s^, which invalidate the assumption that the error-free value of 

is available to the the respective user. This means that power allocation based on (O cannot guarantee 
the expected optimal utility of each user in reality. 

To tackle this problem, in our formulation, we assume that each uncertain parameter s^ is modeled by 
the sum of its estimate (nominal value) and an uncertain term, i.e., sf = s% + dq, where sf, and axe 
the actual, nominal value and error in for the i th user, respectively. Similar to the robust optimization 
in game theory ||2T1 . we assume that the statistics of uncertain parameters are unknown, but the distances 
between the nominal and the actual values of uncertain parameters are bounded with a given probability, 
i.e., 

TZ S = G K s \\\si - Si|| < Si}, Mi^M, Vfc G K. (9) 
where || • || is any definition of norm for the vector space ll24l . §j = \s\, ■ ■ ■ , sf], Sj = [§}, ■ ■ ■ , sf ] 



Si = [sj, ■ ■ ■ , sf], and e, is the bound on the distance between the nominal and the actual value, and 
£j is the size of the uncertainty region. Large values of Si expands the uncertainty region, meaning 
higher uncertainties. Note that this approach can also be applied when the uncertain parameters behave 
stochastically, and the bound on uncertainty can be obtained from the pdf of the error (see Appendix A). 

The uncertain parameter is a new optimization variable in the optimization problem of each user, which 
modifies the utility function of each user to 

K k 

u i (p,s i ) = ^log(l + ?i), (10) 

k=l S i 

and the robust counterpart of © is changed l|20l to 

k u 

max min > log(l H — %■) (11) 
p>,p-> sieK, z — ' s- 

k=l 1 



subject to 



Ci:Zk=lP"<Pr 
C 2 :0<pf <pLk 

We define the corresponding robust game for the objective function (fTTT) by Q = (M, {V^ieM: {ui}ieM)- 
For both games Q and Q, the sets M. and Vi are the set of all users and the set of strategy profiles of 
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each user in d2j, respectively. The difference between these two games comes from the uncertainty in 
the utility function of Q, and when e% = for all players, these two games are the same. In this case, 
the strategy profile p* = {p*, • • • , p* f } is RNE of the game Q if 

^(p^p*.,!*) > Ui(p t ,j?_ t ,Bi), V Pi e V h V§i e n„ Vi e M. (12) 

meaning that no user can achieve a higher utility by unilaterally changeling its strategy under any condition 
of uncertainty at RNE. 

III. Analysis of RNE 

We now present our analysis on RNE's existence and uniqueness. By considering uncertainty in the 
game, equilibrium analysis for Q becomes more complicated than that for Q. This is because the strategy 
of each user depends on strategies of other users as well as on users' uncertainty regions. In addition, 
by considering uncertainty in the system, a new coupling is introduced in the game, which requires new 
signalling between users |S). Hence, design and implementation of such a network is more complicated 
when RNE is considered. Comparing the total achieved utility of the system (i.e., the social utility) at 
RNE with that at NE provides a measure of performance when robustness is introduced. Considering 
these issues, we wish to 

• Simplify the robust game to the extent possible, with a view to simplifying the implementation of 
the system, and 

• Determine the relationship between the social utility at RNE and at NE in both cases of unique 
NE and multiple NEs, and obtain the relation between users' strategies at RNE and the bound on 
uncertainty. 

A. Existence and Uniqueness of RNE 

For any realization of error in the uncertainty region, the utility function for Q in the worst-case robust 
approach, denoted by ^j(p i ,p_.) is 

k p, 

MP ti P- t )= min Vlog(l + ?i), VieM. (13) 

Since the norm function is convex ll24l . and 1Z S in (O is assumed to be bounded and convex, tpi(p i , p_J 
is continuous, and is concave on p., when p . is fixed. Therefore, for any channel realization, any bound 
on the transmit power, and any constraint on spectral mask, there is an equilibrium, called RNE, for the 
game Q (Theorem 2 in (21]). 
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Although one can establish the existence of RNE from the characteristics of 7Z S , obtaining RNE 
requires excessive calculations and depends on the representation of the uncertainty region, meaning 
that the optimal transmit power cannot be obtained in a closed form. Hence, the conditions for RNE's 
uniqueness cannot be obtained in general by the fixed point approach and contraction mapping as in |[T3l . 

m. 

In practice, uncertainties in sub-channels can be considered as independent and identically distributed 
(iid) random variables with Gaussian distribution, e.g., noise in wireless channels 11261 - 11281 . the uncer- 
tainty region can be modeled ET1 as 

S t * = [-4*i,^iL (14) 

where e\ > 0. Compared to ©, the uncertainty region defined by ([141 is decomposed into independent 
intervals for each sub-channel. Hence, a bound on uncertainty, denoted by e\ is considered for each 
sub-channel and each user, which indicates the absolute distance between the nominal and the actual 
interference levels in each sub-channel. For this type of uncertainties, we can simplify the game Q, and 
derive the conditions for uniqueness of its RNE. 

Proposition 1. When (fT4l) holds, RNE of the robust game Q is the same as NE of the game Q with 
the same number of users and strategy profile, and the optimal strategy is the solution to the following 
problem 

k 

max ]Tlog(i+ Pi ) (15) 
p i ,p_ i f-' sf(l + ef) 



f Ci : V? 

subject to 



k=i 

K k ^ „max 



°1 • 2^k=lPi - Pi 

^ C 2 : v\ < pL k - 

Proof: See Appendix B. ■ 
By using Proposition 1, the uncertain value of in the utility function of each user is replaced 
by the scalar variable (1 + e?) multiplied by the estimate of s^. In this way, the uncertainty region is 
represented in a deterministic manner in the robust optimization formula. Comparing the game Q whose 
utility is stated in (TTTT > with the robust game Q whose utility is stated in ([TBI shows that there is no new 
optimization variable in (IT5b . As such, analysis of the robust game Q is simplified and is similar to that 
of the conventional IWFA. The solution to (IT5T > can be obtained similar to that of dD by utilizing the 
Lagrange dual function as 
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where A, is the nonnegative Lagrange multiplier that satisfies ©. Next, we derive the condition for 
uniqueness of RNE in the robust game using the framework in lTT3l . 
Proposition 2. When (fl4l) holds, RNE is unique if 

min{ p(w(fc) + w T (fc)) ^ mk)h} + Mk)h < 1; Vfce/C) (17) 

where p is the spectral radius of the matrix, W(/c) is a M x M matrix whose elements are 

— A [ if i = j 

Wij(k)^{ , k (18) 

the value of ||W(/c)|| 2 is the Z 2 - norm of W(fc), and w(fc) = [e*, • • • , e^-]. When W(fe) is symmetric, 
(fTTT ) reduces to 

p(W(fc)) + ||w(fc)|| 2 <l, fcGX;. (19) 

Proof: See Appendix C. ■ 
The difference between the condition for uniqueness of RNE in the robust game obtained by (fT9l and 
that of the nominal game comes from ||w(fc)||2, which indicates that the condition for RNE's uniqueness 
is tighter than that of the nominal game. This means that for some values of direct and interference 
channel gains in the robust game, (Tf9l is not satisfied, but the same values satisfy the condition for 
uniqueness of NE in the nominal game, i.e., when e\ = 0. Hence, enlarging the uncertainty region of 
the system parameters reduces the probability of having a unique RNE in the robust game as compared 
to the nominal game. 

B. Comparison of Social Utility at RNE and at NE 

Now we discuss the effect of uncertainty on RNE of Q as compared to NE of Q in terms of the total 
throughput of users and the number of sub-channels utilized by each user. 
Theorem 1. When Proposition 2 holds, 

1) The strategy of the robust game Q, denoted by p*, is a decreasing function of e\, i.e., 

3e} k < ef ^p* 1 > p* 2 (20) 

where p* 1 and p* 2 are the strategy at RNE for e\ k and ef k , respectively. 

2) The social utility at RNE of Q is less than that of Q, and is a decreasing function of e\, i.e., 

3e} k < e f => u* 1 > u* 2 (21) 
where u* 1 and u* 2 are the social utility for ej k and e 2k , respectively. 
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Proof: See Appendix D. ■ 
From Theorem 1 , uncertainty will definitely reduce the total throughput of users when RNE is unique, 
and the strategy at RNE is a decreasing function of e\ for all users. However, this may not be true 
when interference is high, i.e., when we encounter multiple NEs in Q. By considering robustness in such 
cases, from (fTol i, we see that users with higher values of e\ have to reduce their transmit power in those 
sub-channels compared to users with smaller values of e\. As such, they cause less interference to other 
users, which is advantageous from other users' points of view. Consequently, we may see a higher total 
throughput at a particular RNE as compared to the case for the corresponding NE, depending on the 
interfering and direct channel gains between users |[7], |H]. To explain the effect of uncertainty in the case 
of multiple NEs, we define the orthogonal equilibrium in interference channels. At orthogonal equilibrium, 
the transmit power levels of different users over each sub-channel are non-overlapping. Consider a subset 
of sub-channels denoted by /Q C JC utilized by user i. At orthogonal equilibrium, we have 

/C i n/C i = VijeM, (22) 

Proposition 3. Uncertainty in the game Q causes convergence to a RNE that has more orthogonality 
than at NE of the game Q. 

Proof: See Appendix E. ■ 

Note that when interference is high, which corresponds to multiple NEs, the IWFA is suboptimal, 
but orthogonal power allocation is optimal |Q3, lTT5l . By considering uncertainty, users are forced to 
the orthogonal power allocation. Hence, the total throughput at RNE may be higher than that of the 
corresponding NE, depending on the values of uncertain parameters, i.e., the interfering and direct channel 
gains between users, noise levels, and power limitations 0, |S). When multiple NEs occur in the game, 
the social utility of users is a non-smooth and non-convex function, and hence, in general, one cannot 
state that its value at RNE is higher or lower than its corresponding value at NE of the nominal game. 

IV. Distributed Algorithm 

A distributed power allocation algorithm without any message passing between users is very desirable 
for spectrum sharing in unlicensed bands. For conventional IWFA, different iterative algorithms are 
presented in 0, lf!4l . E2l that include simultaneous, sequential and asynchronous updating procedures. 
All existing algorithms pertaining to conventional IWFA can be applied in our robust approach without 
any additional complexity, because uncertainty in our formulation is replaced by a scalar value multiplied 
by the estimated value of the uncertain parameter. Among them, we focus on the asynchronous algorithm 
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because each user maximizes its own utility in a totally asynchronous manner, and there is no need for 
any coordination or procedure between users for updating the allocated transmit power levels. As such, 
it is the preferred approach in spectrum sharing environments. Before implementing the asynchronous 
algorithm for the robust approach, we fist present an overview of the assumptions in the asynchronous 
iterative waterfilling scheme ||22| . 

We assume that users update their transmit power levels at discrete instances denoted by T = 
{0, 1,2, • • • }, and p«(i) denotes the transmit power level of user i at iteration t. During t ^ %, the 
transmit power level of user i is unchanged. Let T be the total number of iterations for users' updating 
of their transmit power levels, and if be the last time that user i measured the interference from other 
users at iteration t, where < if < t. We denote the vector of measured interference levels over K sub- 
channels at time if by Si(tf) = [s](tf), • • • , sf (if)]. At each iteration t when user i updates its transmit 
power level, it uses Sj(tf) to solve its optimization problem. The asynchronous distributed algorithm is 
summarized in Table U 

TABLE I 
Distributed Algorithm 

Asynchronous Worst-Case IWFA 
Inputs for each user 

Ti\ The set of iteration times of user i 

tf: Last instance of measuring interference from other users for each iteration, 

Sj (if): Measured interference by user i at tf, 

e\: Uncertainty region for all users in all sub-channels 

Initialization For t — 0, set any feasible power allocation p^O) for all i £ M, 
Iterative algorithm For t = 1, 2, • • • , T: 

Update the transmit power of each user by 

(the solution of (116|) based on Si(tf) when t 6 Ti 
Pi (t) otherwise 

End. 



An important issue for any iterative algorithm is to determine the conditions for its convergence. 
We derive the condition for the convergence of the asynchronous distributed algorithm to its RNE in 
Proposition 4 using the sufficient condition for convergence of the conventional asynchronous IWFA 11221 . 

Proposition 4. As T — > oo, the asynchronous distributed algorithm for the robust IWFA converges to 
the unique RNE from any initial power allocation p,(0) if || W max || 2 + ^AfT||w max || 2 < I, where W™" 
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is a M x M matrix whose elements are 




max fce/c -fg 







if 



if 



i = 



J 



(23) 



and w max is a M x 1 vector whose i th element is maxfcg^ s\e\ 
Proof: See Appendix F. 



From Proposition 4, the condition for convergence of the asynchronous algorithm at RNE depends 
on the uncertainty region as well as on the number of users in the system. A larger uncertainty region 
and/or a higher number of users reduces the probability of convergence of the asynchronous algorithm to 
its optimal point. Again, we see that this condition is tighter than that of the game without uncertainty, 
meaning that the probability of divergence of the distributed algorithm at RNE is higher than that of the 
distributed algorithm at NE. 



Now we provide simulation results to get an insight into the performance of Q for different bounds on 
uncertainty as compared to Q. In the following simulation, for convenience we assume that the values of 



total utility of users at RNE, which is the Shannon rates for users. 
A. Unique NE 

Figs. [TJa) and Q2b) show the effect of uncertainty on the total throughput of users when Proposition 2 
holds, i.e., when RNE is unique, and multiuser interference is low. In this set up, the number of users is 8, 
the number of sub-channels is 64, and p^ ask = p max . The values of h^, hj { , and a\ are randomly chosen 
from the intervals [0,0.1], [0,0.01], and [0,0.01], respectively, guaranteing that Proposition 2 holds, and 
are multiplied by fading coefficients. The estimated error is assumed to be symmetrically distributed in 
[— e, e] for all 64 sub-channels and for all users, and is added to the nominal value of s\. 

In Fig. (Ha), the value of s\ is uncertain, but in Fig. [Tib), while the exact value of s\ is available, it is 
assumed to be uncertain, i.e., s\ is replaced by (1 + e)s^. We take the average of total throughput values 
of all users for 20 realizations of channel gains, each with a different error value e. Note that expanding 
the bound on uncertainty, reduces the total throughput of users as compared to the case that there is 
no uncertainty, as expected form Theorem 1, since the social utility of the robust game is a decreasing 
function of e. The impact of uncertainty in Fig. [TJb) is much less than that in Fig. [Ha), meaning that in 
such cases, the utility of each user is not significantly affected by higher interference. 



V. Simulation Results 



e\ are equal for all users and all sub-channels, and denote it by e. In all simulations, we compare the 
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Fig. 1. Total throughput of users for different values of e when Proposition 2 holds (i.e., when multiuser interference is low). 




Fig. 2. Total throughput of users for different values of e when Proposition 2 does not hold (i.e., when multiuser interference 
is high). 



B. Multiple NEs 

To show the impact of uncertainty in cases that we encounter multiple NEs, we assume that Proposition 
2 does not hold, meaning that multiuser interference is very high. The values of h^, h^, and a\ are 
randomly chosen from the intervals [0,0.1], [0, 1], and [0,0.01] respectively. Again, we consider 8 users 
and 64 sub-channels, and take the average of total throughput values of all users for 20 realizations of 
channel gains, each with a different error value e. The results are shown in Figs. [2] (a) and (b). In Fig. 
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|2] (a), users encounter uncertainty, and in Fig. |2] (b), although the exact value of is available, it is 
assumed to be uncertain, i.e., is replaced by (1 + e)s^. 

As expected from Proposition 3, for some values of uncertainty, the robust game has a better perfor- 
mance than that of the conventional IWFA in both of the above cases, because uncertainty causes the 
game to converge to the orthogonal NE, resulting in a higher total throughput in some cases. The same 
is numerically shown in 0, where the average throughput in the robust power allocation problem is 
shown to be very close to that of the conventional IWFA, and in Q, where a higher throughput for the 
probabilistic robust algorithm is reported as compared to that of the case where complete information is 
utilized by IWFA. Also, as we see in Fig. [2] (b), in high interference scenarios, a higher estimate for the 
interference is advantageous as it may lead to orthogonal power allocations and consequently, a higher 
utility for each user, as expected from Proposition 3. 



TABLE II 

Channel Gains of 3 users 



k 


1 


2 


3 


4 


5 


6 


hu 


20.52 


2.0 


2.08 


10.56 


0.44 


1.6 


hi2 


4.91 


4.97 


3.95 


3.94 


2.95 


5.95 


hi3 


7.9 


5.97 


2.97 


4.92 


1.93 


6.94 


h,2i 


0.92 


0.94 


0.95 


0.92 


0.95 


0.99 


hii 


2.44 


26.32 


23.2 


3.64 


3.92 


0.68 


h 23 


0.91 


0.96 


0.99 


0.99 


0.934 


0.95 


h 3 i 


0.91 


0.95 


0.98 


0.98 


0.93 


0.96 


h 3 2 


0.93 


0.96 


0.90 


0.96 


0.98 


0.97 




3.6 


24 


6 


1.6 


34 


40 


o\ 


2.2 


0.26 


4.1 


3.06 


0.02 


0.02 


°l 


8.24 


0.08 


0.18 


0.08 


0.04 


0.06 


2 
°"3 


0.22 


0.26 


4.08 


1.06 


0.02 


0.02 



To observe how the robust power allocation algorithms converge to the orthogonal equilibrium, let 
us consider 3 users in the system, K = 6, p mm = 1, p^ask = 0-5 Watts, and channel gains and noise 
coefficients as in Table [ill In Tables [III] and ITVl we show the allocated power to each user in Q and Q, 
respectively. As can be seen for Q, users spread their allocated transmit power in different sub-channels, 
and induce interference to other users. Note that user 1 uses k = 1,2,4, whereas at RNE of Q, each 
user concentrates its power on the best sub-channels, e.g., user 1 only uses sub-channels 1 and 4, whose 
direct channel gains denoted by h\ x and h\-y are higher than those of other sub-channels, and whose 
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interference channel gains denoted by h\ x , h\ x , h\±, and are lower than those of other sub-channels 
as shown in Table ITT1 The same is true for users 2 and 3. This means that in the game Q, all users use 
their best sub-channels and the allocated transmit power levels to users are orthogonal, i.e., there is no 
interference between users; hence the total aggregate throughput of users is increased. As can be seen 
in Tables [III] and ITVl in this case, the throughput of each user is also increased as compared to those of 
the game Q. However, in general, the throughput of each user depends on its channel, and may not be 
increased in all instances in the robust game. 



TABLE III 

Power Allocation by 3 users at NE of Q 



useri 


Ui 


Pi 


P2 


P3 


P4 


P5 


P6 


useri 


1.92 


0.44 


0.1 





0.45 








user2 


3.82 





0.5 


0.5 











user3 


10.9 





0.0059 


0.3049 





0.32 


0.37 



TABLE IV 

Power Allocation by 3 users at RNE of Q for e = 3 



useri 


Ui 


Pi 


P2 


P3 


PA 


P5 


P6 


useri 


1.93 


0.5 








0.5 








user2 


3.95 





0.5 


0.5 











user3 


11.17 














0.5 


0.5 



C. Comparison of Performances of Worst-Case and Probabilistic Approaches 

Finally, we compare the performance of our proposed RNE with that of the probabilistic approach 
in Q that guarantees that the achieved throughput of users is higher than a specific value with a given 
probability 5q under any level of uncertainty in the value of IN in each sub-channel. The value of 5q = 
means that there is no guarantee to achieve the specific data rate under any level of uncertainty in IN, and 
higher values of do provides more protection for the required data rate against uncertainty in IN levels. 
In Q, the objective function of the robust game is changed to the probability of achieving different data 
rates, which is generally hard to solve. To simplify the problem and obtain a closed form solution, they 
assumed that uncertainty in each parameter is confined to (TBI) and its probability density function (pdf) 
is uniform. Under such assumptions, the robust probabilistic counterpart of Q is simplified in such a way 
that the uncertainty multiplier for s\ in ( fl"5l ) in our worst-case algorithm, i.e., (1 + e) is replaced by 
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Fig. 3. Total throughput of users for different values of So in the probabilistic approach as compared to that of the worst-case 
approach when Proposition 2 holds (i.e., when multiuser interference is low). 



(1 — e + 2xex 5o). Hence, one can consider the probabilistic approach as a special case of worst-case 
approach with uncertainty bound (1 — e + 2xex 5o). When < 5q < 0.5, the effect of uncertainty on 
NE of the probabilistic approach is less than that of the worst-case approach; and when 0.5 < do < 1, 
the probabilistic approach is more robust than the worst-case approach. This phenomenon is shown in 
Figs. [3] and [4] for the case with a unique RNE and for multiple RNEs, respectively. 

As another example, we now consider e = 0.8 to compare the performances of the worst-case and 
probabilistic approaches for different values of 5rj- When RNE is unique and < 5o < 0.5, i.e., (1 — e + 
2 x e x 5q) < + the social utility of the probabilistic approach is higher than that of the worst-case 
approach, which is in line with Theorem 1 , since the social utility is a decreasing function of the size of 
the uncertainty region. In contrast, for 0.5 < Sq < 1, i.e., when (1 — e + 2 x e x 5$) > (1 + e), the social 
utility of the worst-case approach is higher than that of the probabilistic approach at the RNE. This may 
not be true for the case of multiple RNEs. As stated in Proposition 3, uncertainty may result in more 
orthogonality at a RNE as compared to the non-robust approach and/or to the case with less uncertainty. 
In such cases, the total throughput may be higher at a RNE, as shown in Fig. |4] 

VI. Conclusions 

We studied the impact of uncertainty in the channel state information and in interference levels on the 
total throughput of users in shared unlicensed spectrum via robust game theory. To devise a robust power 
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Fig. 4. Total throughput of users for different values of So for the probabilistic approach as compared to that of the worst-case 
approach when Proposition 2 does not hold (i.e., when multiuser interference is high). 

allocation in such environments, we focused on bounded and symmetrically distributed uncertainties, and 
showed that this game can be considered as a conventional IWFA with system parameters multiplied 
by bounds on uncertainty. The conditions for existence and uniqueness of RNE and for convergence of 
the proposed distributed algorithms of the robust game were derived via the conventional IWFA. The 
performance of the robust game was compared to that of the conventional IWFA in terms of its total 
throughput. In the case of multiple RNEs, we showed that the orthogonal use of sub-channels by users 
at a RNE may lead to a higher total throughput of users as compared to that of the conventional IWFA. 

Appendix A 
Modeling Uncertainty by Norm Function 

In this appendix, we explain the relationship between the size of the uncertainty region denoted by £j, 
and the stochastic nature of the uncertain parameters by utilizing Section 8.5.5. in |[T9l and |[29l . Let x 
be the uncertain parameter for which we have x = x — x, where x, x, and x are the exact value, the 
nominal (or estimated) value, and the error in x, respectively. Assume that error has a specific probability 
distribution function (pdf) /(x), such as Gaussian or uniform. One can find the uncertainty region in 
such a way that with probability P, any realization of uncertain parameter falls in the uncertainty region. 



19 



The generic formulation of this statement is 

/(x - x)dx < P (24) 



L 



||x-x||<Ej 

For different types of uncertainty, each with a different pdf, a different uncertainty region can be obtained. 

Appendix B 
Proof of Proposition 1 

As in Theorem 4 in GTTl . consider a robust finite game, with M players, without private information, in 
which Ui(xi, at) is a continuous and differentiable utility function for the i th player, Xj is the strategy vector 
of that player, a« is the vector of uncertain parameters where aji is its j th element, and its uncertainty 
region is defined by the following interval 

where a^° wer and a"f er are the corresponding lower and upper bounds of the uncertain parameter, respec- 
tively. We denote the utility of the nominal game for user i by Ui(%i,sq), where af is the deterministic 
vector of system parameter and aj i is its j th element. Note that af is not the optimization vector in the 
nominal game, and that the nominal game has only one optimization vector, namely Xj. 

For the robust game, the utility function for user i is denoted by Ui(xj,aj), where a.j is the vector of 
uncertain parameter, and both at and Xj are the optimization vectors. The RNE of the robust game is 
{xi, • • • , xjv/ } iff it is also the NE of a finite game with complete information, and with the same number 
of players and the same strategy space, with the following utility function (Theorem 4 in 11211 ) 

«i(xj,af) =Ui(xi,af), (25) 

where af is the new vector related to the uncertain parameter and its j th element aj i is 

r upper if ^(a„x,) q 

I «r if < o- 

In the above reformulation, the robust utility function has only one optimization vector, i.e., Xj, and the 
uncertain parameter is replaced by the deterministic value that depends on the derivative of the robust 
utility function with respect to its uncertain parameter. In our robust game Q, the derivative of (TTOl i with 
respect to the uncertain parameter is 
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Since p k > and interference is always a positive value, we have 

fl<° 08) 

For our robust game, the upper bound of the uncertain parameter in each sub-channel denoted by a"f er 
is equal to s k + £iS k . Hence, the RNE can be obtained when 

u i (p,sf) = u i (p,sf) (29) 

where is a deterministic vector of the uncertainty Sj, and sf k is its k th elements where s^ k = s k + £iS k . 
Hence, we have 

K k 

2»(p,Si) = («i(P.Si))a{*=sf+€iS> = 22 l °s( 1 + - kh 1 fc J - (30) 

fe=i ^U + ^J 

Appendix C 
Proof of Proposition 2 

For the complete information game Q, NE is unique |fl"3l if 

p(W(fc)) < 1 VA: g /C, (31) 

where p is the spectral radius of W(k), and W(fc) isaMxM matrix whose elements are 

if i = j 

W ij (k) = { hk (32) 

1$ if ' •• •>'• 

By considering uncertainty in Sj, the robust game Q has a unique RNE if 

max pCW(k)) < 1. (33) 

If the uncertainty region is modeled by ([14l . we have W(/c) = W(k) + W(k), where W(k) is a M x M 
matrix whose elements are 

_ f if i = j 

W ij (k) = \ hk (34) 
and W(/c) is a matrix of the uncertain parts of system parameters in which the sum of its i th row is less 



t'2 



than e k . Recall that Frobenius norm of a matrix is || Wij(k) \\p = ^ j j (k) and that || W^ij (A;) || 2 < 
WWMWf. Thus 



max p(W(fc)) < ||Wij(fc)|| 2 + ||Wij(fc)|| 2 < ||V^^-(fc)|| 2 + < ||^#)|| 2 + ||w fc || 2 . (35) 
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where w fc = [e*, • • • ,£ k M ]- On the other hand, from Theorem 1.1 in [30] we have 

F + F^ 

max p(F + G) < p( — - — ) + 1. 

||G|| F <1 2 

Thus 

~ w + W T u 

max p(W + W)<p( ) + ||w fc || 2 . 

l|W|| F <||w*=|| 2 ^ 

For a symmetric W, we have W = W , p( w + w ) — p(W) < ||Wjj(fc)||2, and hence, (TT7T ) reduces to 
(EH). 

Appendix D 
Proof of Theorem 1 

To prove this Theorem, we use variational inequalities (VI) to reformulate NE, and derive the rela- 
tionship between p* and p*. 

Step 1: Consider that the nominal NE is the solution to the following variational inequalities (Propo- 
sition 1.4.2 in [IT] and ifToll ). 

p* = Solution to (VI{V,F)) (36) 

where V = \[ ieM Vi, T = {T^, T % = a t + Vf . M, ;Pr CT; = (af/^)f =1 , and M tJ = 
diag(^ L )*£ 1 . Considering uncertainty in the parameters can be viewed as perturbation in T = (J r j)*£ 1 , 
which we show by T = (Ti)f£ v where T{ has the same definition as Ti except that <Xj = (af(l + 

et)/ h u)k=i and M H = ' hP )j=v From ^ above > 

we consider the solution to Q as a solution 
to VI(V, F + q), where q = maxef^f. For the Affine VI, when Proposition 2 holds, since M is strictly 
copositive, T is strongly monotone (l3Tb . 

Step 2: When T is strongly monotone, the solution to VI{T',J : + q), i.e., ip(—q) is a monotone plus 
single-valued map (Corollary 2.9.17 in ED). 

Statement: When T is strongly monotone, tp{—q) is a decreasing function of — q. 

Proof: Recall that when T is strongly monotone, ^>{—q) is monotone (Corollary 2.9.17 in ||3T| ). To 
prove this statement, we first assume that (p(—q) is an increasing monotone function of — q, i.e., 

CI: - qi < -q 2 y{-qi) < v{-q2), 

From the definition of VI for any concave optimization problem (Chapter 1 in OT1 ). we have 

(b-<p(-q))(T + q) <0, VbGP. (37) 
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Since tp(—qi) and tp(—q 2 ) belong to V, we have 

(ip(- qi ) - ip(-q 2 ))(T + q 2 ) < (38) 
(tp(-q 2 ) - <p(-qi))(F + qi) < (39) 

We subtract (|38l ) from (|39l and write 

(<p(-qi)-<p(-ta))(q2-qi)<0, (40) 

From CI, we have (tp(— q\) — tp(— q 2 )) < 0. Hence, to hold (l40l) . we should have q 2 — q\ > or q 2 > q\. 
Clearly, q 2 > q\ contradicts with CI. This contradiction shows that ip(—q) is a decreasing monotone 
function of —q. ■ 
In our problem, (f(—q) is the solution to the robust game and we have q = maxe*^ for all sub- 
channels and all users. This means that by increasing uncertainty, the power allocated to each user, i.e., 
cp(—q), is reduced as compared to that of the nominal game. In other words, when ej k > ef k for all 
sub-channels, and pj and P2 are the RNE of Q for e\ k and e? fc , we have 

ef>ef Vk,^pl<p*. (41) 

Also, for affine VI, the solution set is closed and continuous (Corollary 2.6.4 of (31]). Therefore, the 
strategy at RNE, i.e., p* is a decreasing function of e\ (Proof of Part 1 of Theorem 1 in ||32| ). Also, for 
the nominal game, when ef k = 0, we have 

e f>0 V&,^p*<p*. (42) 

Step 3: Since F is strongly monotone, the utility function is strictly concave. Hence, for (|4T1) . we have 

Pi < P2 => E 5 (Pl) < E 5 (P2)> ( 43 ) 

ieM ieM 

where J2ieM ^(Pi) an( * J2ieM "(P2) are tne soc i a l utilities at RNE of £? for and ef k , respectively. 
The social utility of the nominal game is obtained when e\ = for all users and for all sub-channels in 
Q. Since the social utility is a decreasing function of e k , we have 

e k > Vfc, => P * > p* J] 5i(p*) < £ «i(P*)> (44) 

where X]iGA4^*(P*) an ^ Sie.M are tne soc i a l utilities of Q and respectively. Therefore, the 

social utility of the robust game is always less than that of the nominal game. 



23 



Appendix E 
Proof of Proposition 3 

Assume that the i th user converges to p* at NE of Q, for which there is a corresponding s^*, and the 
set of all sub-channels with nonzero power allocation by the i th user is denoted by I*. Consequently, p*, 
s* k , and X* belongs to the game Q. In what follows, we will show that X* C X*. In doing so, we denote 
the Lagrange multipliers at NE of the games Q and Q by A* and A*, respectively, which are increasing 
functions of s\. For user i we have 

\ i hex: ™ 
where q ^ 2^. Obviously, p* of the i th user leads to s k * < s k Vi, k. Therefore, for any power allocation 
strategy p.; 6 p, we have 

1^^ + " <(1 + e .) gi^Ml±^ (46 ) 

From (|45T ) and (l46l ). those sub-channels that are not used in are not used in Q as well. Now, as stated 
in Theorem 1 in |[T3l . when multi-user interference is high, an orthogonal NE always exists for the game 
Q. When the i th user chooses a q' € Xi, it is orthogonal to those of other users. Assuming this, for any 
other power allocation profile of other users, we have 



(1 + 4)tf<( 1 + 4') ^ Kf ' ' , V,e^. (47) 



it 



Since s* fc 3> 1, the utility at RNE for each user is higher than that of any other strategy profile. Hence, 
there is no incentive for other users to change their strategy profile from the orthogonal RNE. As such, 
RNE of Q is more orthogonal than NE of Q. 

Appendix F 
Proof of Proposition 4 

For the game with complete information Q, it is proved in Theorems 3 in E2l that the asynchronous 
distributed algorithm converges if 

p(W max ) < 1 VA; € /C, (48) 

where p is the spectral radius of W max , and W max is a M x M matrix whose elements are 

f if % = j 

"T h% .,. ' (49) 
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From (fT4b . the robust game Q converges to RNE by using the iterative asynchronous algorithm if 

max p(W max ) < 1. (50) 
In this case, we have W max = W ma " + W , where W is the uncertain parts of W max , whose elements 



are 



if i = j 
max if i ^ j. 



Since WJO** < maxefsf, from (1361 ) we have 



max p(W max ) < HW^IIa + \\W l3 {k)\\ F < \\W™\\ 2 + VWl|w ma i 2 . (52) 
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